The MVAPICH project: Transforming research into high-performance MPI library for HPC community

Introducing Endpoints into the EMPI4Re MPI library

Endpoints is a topic under discussion within the MPI forum [3] that proposes to introduce a new communicator creation function that creates a communicator with multiple ranks for each MPI process in a parent communicator. In this talk we will discuss our initial implementation of endpoints in our research MPI library, called EMPI4Re. The Exascale MPI library for Research (the EMPI4Re library) i...

MPI Streams for HPC Applications

Data streams are a sequence of data flowing between source and destination processes. Streaming is widely used for signal, image and video processing for its efficiency in pipelining and effectiveness in reducing demand for memory. The goal of this work is to extend the use of data streams to support both conventional scientific applications and emerging data analytic applications running on HP...

High-Performance Computing (HPC)

Open MPI: A Flexible High Performance MPI

A large number of MPI implementations are currently available, each of which emphasize different aspects of high-performance computing or are intended to solve a specific research problem. The result is a myriad of incompatible MPI implementations, all of which require separate installation, and the combination of which present significant logistical challenges for end users. Building upon prio...

SPIDAL Java: high performance data analytics with Java and MPI on large multicore HPC clusters

Within the last few years, there have been significant contributions to Java-based big data frameworks and libraries such as Apache Hadoop, Spark, and Storm. While these systems are rich in interoperability and features, developing high performance big data analytic applications is challenging. Also, the study of performance characteristics and high performance optimizations is lacking in the l...